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The basic notions of statistical mechanics (microstates, multiplicities) are quite simple, but un¬ 
derstanding how the second law arises from these ideas requires working with cumbersomely large 
numbers. To avoid getting bogged down in mathematics, one can compute multiplicities numerically 
for a simple model system such as an Einstein solid—a collection of identical quantum harmonic 
oscillators. A computer spreadsheet program or comparable software can compute the required com¬ 
binatoric functions for systems containing a few hundred oscillators and units of energy. When two 
such systems can exchange energy, one immediately sees that some configurations are overwhelm¬ 
ingly more probable than others. Graphs of entropy vs. energy for the two systems can be used to 
motivate the theoretical definition of temperature, T = {dS/dU)~^, thus bridging the gap between 
the classical and statistical approaches to entropy. Further spreadsheet exercises can be used to 
compute the heat capacity of an Einstein solid, study the Boltzmann distribution, and explore the 
properties of a two-state paramagnetic system. @1997 American Association of Physics Teachers. 
Published in Am. J. Phys. 65 (1), 26-36 (1997), <http://dx.doi.Org/10.1119/l.18490>. 


I. INTRODUCTION 

Entropy is a crucial concept in thermal physics. A 
solid understanding of what entropy is and how it works 
is the key to understanding a broad range of physical 
phenomena, and enhances one’s understanding of an even 
wider range of phenomena. The idea of entropy and its 
(nearly) inevitable increase are thus core concepts that 
we should hope physics students at all levels would study 
carefully and learn to apply successfully.^ 

Unfortunately, the approach to teaching entropy found 
in virtually all introductory and many upper-level text¬ 
books is more abstract than it needs to be. Such texts^ 
introduce entropy in the context of macroscopic thermo¬ 
dynamics, using heat engines and Carnot cycles to mo¬ 
tivate the discussion, ultimately defining entropy to be 
the quantity that increases by Q/T when energy Q is 
transferred by heating to a system at temperature T. In 
spite of the way that this approach mirrors the histori¬ 
cal development of the idea of entropy, our students have 
usually found the intricate logic and abstraction involved 
in getting to this definition too subtle to give them any 
intuitive sense of what entropy is and what it measures; 
the concept ultimately remains for them simply a for¬ 
mula to memorize.^ Most introductory texts attempt to 
deal with this problem by including a section about how 
entropy quantifies “disorder”. The accuracy and utility 
of this idea, however, depends on exactly how students 
visualize “disorder”, and in many situations this idea is 
unhelpful or even actively misleading.^ The macroscopic 
approach therefore generally does not help students de¬ 
velop the kind of accurate and useful intuitive under¬ 
standing of this very important concept that we would 
like them to have. 

The statistical interpretation of entropy (as the loga¬ 
rithm of the the number of quantum microstates consis¬ 
tent with a system’s macrostate) is, comparatively, quite 


concrete and straightforward. The problem here is that 
it is not trivial to show from this definition that the en¬ 
tropy of a macroscopic system of interacting objects will 
inevitably increase.® 

This paper describes our attempt to link the statistical 
definition of entropy to the second law of thermodynam¬ 
ics in a way that is as accessible to students as possible.® 
Our primary motivation was to create a more contem¬ 
porary approach to entropy to serve as the heart of one 
of the six modules for Six Ideas That Shaped Physics, 
a new calculus-based introductory course developed with 
the support and assistance of the Introductory University 
Physics Project (lUPP). However, we have found this ap¬ 
proach to be equally useful in upper-level undergraduate 
courses. 

The key to our approach is the use of a computer to 
count the numbers of microstates associated with vari¬ 
ous macrostates of a simple model system. While the 
processes involved in the calculation are simple and easy 
to understand, the computer makes it practical to do the 
calculation for systems large enough to display the ir¬ 
reversible behavior of macroscopic objects. This vividly 
displays the link between the statistical definition of en¬ 
tropy and the second law without using any sophisti¬ 
cated mathematics. Our approach has proved to be very 
helpful to upper-level students and is the basis of one of 
the most successful sections of the Six Ideas introduc¬ 
tory course.^ Depending on the level of the course and 
the time available, the computer-based approach can be 
used either as the primary tool or as a springboard to the 
more powerful analytic methods presented in statistical 
mechanics texts. 

A number of choices are available for the specific com¬ 
putational environment: a standard spreadsheet program 
such as Microsoft Excel or Borland QuattroPro; a stand¬ 
alone program specially written for the purpose; or even 
a graphing calculator such as the TI-82. We will use 
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spreadsheets in our examples in the main body of this 
paper, and briefly describe the other alternatives in Sec¬ 
tion VI. 

After some preliminary definitions in Section II, we 
present the core of our approach, the consideration of 
two interacting “Einstein solids”, in Section III. In the re¬ 
maining sections we derive the relation between entropy, 
heat, and temperature, then go on to describe a num¬ 
ber of other applications of spreadsheet calculations in 
statistical mechanics. 


II. PHYSICS BACKGROUND 
A. Basic concepts of statistical physics 

The aim of statistical mechanics is to explain the be¬ 
havior of systems comprised of a very large number of 
particles. We can characterize the physical state of such 
a system in either of two ways, depending on whether we 
focus on its characteristics at the macroscopic or molec¬ 
ular level. 

The macrostate of a system is its state as viewed 
at a macroscopic level. For instance, to describe the 
macrostate of a tank of helium gas, we could specify 
the number of molecules N it contains, the total vol¬ 
ume V that they occupy, and their total internal en¬ 
ergy U. As long as the gas is in internal thermal equi¬ 
librium, these three parameters suffice to determine its 
macrostate. (Other thermodynamic variables, such as 
the temperature T and the pressure P of the gas, can 
then be calculated using various “equations of state” 
such as the ideal gas law PV = NkT and the relation 
U = ^NkT, where k is Boltzmann’s constant.) In gen¬ 
eral, the macrostate of a system is determined by the 
various conservation laws and physical constraints that 
it is subject to. 

The microstate of a system is its state as viewed at 
the molecular level. To describe the microstate of our 
tank of helium gas, we would have to specify the exact 
position and velocity (or quantum mechanical wavefunc- 
tion) of each individual molecule. Note that if we know 
a system’s microstate, we also know its macrostate: The 
total energy U, for instance, is just the sum of the ener¬ 
gies of all the molecules. On the other hand, knowing a 
system’s macrostate does not mean we’re anywhere close 
to knowing its microstate. 

The number of microstates that are consistent with 
a given macrostate is called the multiplicity of that 
macrostate, denoted O. Equivalently, O is the number 
of accessible microstates, limited only by the constraints 
that determine the macrostate. For our tank of helium 
gas, the multiplicity would be a function of three macro¬ 
scopic variables, for instance, N). In most cases 

the multiplicity will be a very large number, since there 
will be an enormous number of different ways to dis¬ 
tribute a given amount of energy among the system’s 
molecules (and, for fluids, to distribute the molecules 


within the available volume). 

The fundamental assumption of statistical mechanics is 
that an isolated system in a given macrostate is equally 
likely to be in any of its accessible microstates. This 
means that the probability of finding the system in any 
given microstate is I/O, since there are O microstates, 
all equally probable. In the next section we will see how 
this assumption leads to the conclusion that macroscopic 
objects must exhibit irreversible behavior, such as the 
spontaneous flow of energy from a hot object to a cold 
one. In order to make this argument concrete, though, we 
will focus our attention on a specific model for a thermo¬ 
dynamic system, since the exact way that a macrostate’s 
multiplicity depends on N, U, and V depends on what 
physical system we are considering. Once we understand 
how the argument works for our specific model, we will be 
able to understand (at least qualitatively) how it would 
apply to other physical systems. 

B. The Einstein solid model 

There are only a few realistic systems whose multiplic¬ 
ities can be calculated using elementary methods. Even 
an ideal gas is too complicated in this regard—a direct 
derivation of its multiplicity function requires some fairly 
sophisticated tools.® A much simpler system would be 
one whose particles are all fixed in place (so the vol¬ 
ume is irrelevant), storing energy in units that are all the 
same size. This idealized model is treated in many sta¬ 
tistical mechanics texts.® Physically, it corresponds to a 
collection of identical quantum harmonic oscillators. In 
1907, Einstein proposed such a model to describe the 
thermal properties of a simple crystalline solid, treating 
each atom as an independent three-dimensional harmonic 
oscillator. We will therefore call this model an Einstein 
solid. 

We will use N to denote the number of one-dimensional 
oscillators in an Einstein solid. (So the number of atoms 
is N/3.) If we neglect the static zero-point energy (which 
plays no role in the thermal behavior), then the energy 
of any oscillator can be written 

E = en, (1) 

where n is a nonnegative integer and e is a constant (e = 
hf, where / is the oscillator’s natural frequency). In 
other words, each oscillator can store any number of units 
of energy, all of the same size. The total energy of the 
entire solid can thus be written 

U = eq, (2) 

where q is another nonnegative integer. The multiplicity 
of an Einstein solid is some function of N and q: the 
number of ways of arranging q units of energy among N 
oscillators. 

For a very small Einstein solid one can simply count 
all the ways of arranging the energy among the oscil¬ 
lators. For example, if N = q = 3, the following 10 
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FIG. 1. Computation of the multiplicies for two Einstein solids, each containing three oscillators, which share a total of six 
units of energy. The individual multiplicities (Ha and Qb) can be computed by simply counting the various microstates, or by 
applying Eq. (3). The total multiplicity fltotai is the product of the individual multiplicities, because there are Qb microstates 
of solid B for each of the IIa microstates of solid A. The total number of microstates (462) is computed as the sum of the 
last column, but can be checked by applying Eq. (3) to the combined system of six oscillators and six energy units. The final 
column is plotted in the graph at right. 


distinct distributions are possible (where the first num¬ 
ber in each triplet specifies the number of energy units 
in the first oscillator, the second the number of energy 
units in the second oscillator, etc.): 300, 030, 003, 210, 
120, 201, 102, 021, 012, 111. Thus the multiplicity of this 
macrostate is 12 = 10. By directly counting microstates 
in this manner, one can not only vividly illustrate the 
concepts of macrostates and microstates to first-year stu¬ 
dents, but also show how the multiplicity increases very 
sharply with both N and q, without using any difficult 
mathematics. 

The general formula for the multiplicity of an Einstein 
solid is 


n{N,q) 


q + N-I 

q 


{q + N-iy. 
ql{N-iy. 

{U/e + N-iy 
iU/e)KN-iy 


An elegant derivation of this formula can be found in 
the textbook of Callen.^° In brief, the trick is to repre¬ 
sent any microstate as a sequence of dots (representing 
energy units) and lines (representing partitions between 
one oscillator and the next). A total of q dots and — 1 
lines are required, for a total of g -I- Af — 1 symbols. The 
number of possible arrangements is just the number of 
ways of choosing q of these symbols to be dots. 

Whether or not one derives formula (3) in class, stu¬ 
dents have little trouble believing it after they have ver¬ 
ified a few simple cases by brute-force counting. In an 
introductory course, this is all we usually have them do. 


III. INTERACTING SYSTEMS 

To understand irreversible processes and the second 
law, we now move on to consider a system of two Einstein 
solids, A and B, which are free to exchange energy with 
each other but isolated from the rest of the universe. 

First we should be clear about what is meant by the 
“macrostate” of such a composite system. For simplicity. 


we assume that our two solids are weakly coupled, so that 
the exchange of energy between them is much slower than 
the exchange of energy among atoms within each solid. 
Then the individual energies of the two solids, Ua and 
Ub, will change only slowly; over sufficiently short time 
scales they are essentially fixed. We will use the word 
“macrostate” to refer to the state of the combined sys¬ 
tem, as specified by the (temporarily) constrained values 
of Ua and Ub- For any such macrostate we can com¬ 
pute the multiplicity, as we shall soon see. However, on 
longer time scales the values of Ua and Ub will change, 
so we will also talk about the total multiplicity of the 
combined system, considering all microstates to be “ac¬ 
cessible” with only C/totai = Ua + Ub held fixed. In any 
case, we must also specify the number of oscillators in 
each solid, Na and Nb, in order to fully describe the 
macrostate of the system. 

Let us start with a very small system, in which each of 
the “solids” contains only three oscillators and the solids 
share a total of six units of energy: 

Na=Nb=3; 
gtotal = qA + qs = G- 

Given these parameters, we must still specify the indi¬ 
vidual value of qA or qB to describe the macrostate of 
the system. There are seven possible macrostates, with 
= 0, 1, ... 6. For each of these macrostates, we can 
compute the multiplicity of the combined system as the 
product of the multiplicities of the individual systems: 

f^total — ^A^B- (h) 

This works because the systems are independent of each 
other: For each of the Qa microstates accessible to solid 
A, there are Qb microstates accessible to solid B. A ta¬ 
ble of the various possible values of Ha, Qb, and Htotai 
is shown in Fig. 1. Students can easily construct this ta¬ 
ble for themselves, computing the multiplicities by brute- 
force counting if necessary. 

From the table we see that the fourth macrostate, in 
which each solid has three units of energy, has the highest 
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FIG. 2. Formulas from the Excel spreadsheet that produced Fig. 1. (Most of the formulas can be generated automatically 
by copying from one row to the next. Dollar signs indicate “absolute” references, which remain unchanged when a formula is 
copied.) 


multiplicity (100). Now let us invoke the fundamental as¬ 
sumption: On long time scales, all of the 462 microstates 
are accessible to the system, and therefore, by assump¬ 
tion, are equally probable. The probability of finding the 
system in any given mocrostate is therefore proportional 
to that macrostate’s multiplicity. For instance, in this 
example the fourth macrostate is the most probable, and 
we would expect to find the system in this macrostate 
100/462 of the time. The macrostates in which one solid 
or the other has all six units of energy are less probable, 
but not overwhelmingly so. 

Another way to construct the table of Fig. 1 is to use 
a computer spreadsheet program. Both Microsoft Ex¬ 
cel and Borland QuattroPro include built-in functions 
for computing binomial coefficients: 

/'q-\-N-l\ _ fcOMBIN(q+N-l,q) in Excel] 

V q ) ~ 1 MULTINDMIAL(q,N-l) in QuattroPro. 

( 6 ) 

The formulas from the Excel spreadsheet that produced 
Fig. 1 are shown in Fig. 2. 

The advantage in using a computer is that it is now 
easy to change the parameters to consider larger sys¬ 
tems. Changing the numbers of oscillators in the two 
solids can be accomplished by merely typing new num¬ 
bers in cells B2 and D2. Changing the number of energy 
units requires also adding more lines to the spreadsheet. 
The spreadsheet becomes rather cumbersome with much 
more than a few hundred energy units, while overflow 
errors can occur if there are more than a few thousand 
oscillators in each solid. Fortunately, most of the impor¬ 
tant qualitative features of thermally interacting systems 
can be observed long before these limits are reached. 

Figure 3 shows a spreadsheet-generated table, and a 
plot of fltotai vs. qA, for the parameters 

Na = 300, Nb = 200, gtotai = 100. (7) 

We see immediately that the multiplicities are now quite 
large. But more importantly, the multiplicities of the 
various macrostates now differ by faetors that can be 
very large—more than 10^^ in the most extreme case. If 


we again make the fundamental assumption, this result 
implies that the most likely macrostates are 10^^ times 
more probable than the least likely macrostates. If this 
system is initially in one of the less probable macrostates, 
and we then put the two solids in thermal contact and 
wait a while, we are almost eertain to find it fairly near 
the most probable macrostate of qA = 60 when we check 
again later. In other words, this system will exhibit irre¬ 
versible behavior, with net energy flowing spontaneously 
from one solid to the other, until it is near the most 
likely macrostate. This conclusion is just a statement of 
the second law of thermodynamics. 

There is one important limitation in working with sys¬ 
tems of only a few hundred particles. According to the 
graph of Fig. 3, there are actually quite a few macrostates 
with multiplicities nearly as large as that of the most 
likely macrostate. In relative terms, however, the width 
of this peak will decrease as the numbers of oscillators 
and energy units increase. This is already apparent in 
comparing Figs. 1 and 3. If the numbers were increased 
further, we would eventually find that the relative width 
of the peak (compared to the entire horizontal scale of the 
graph) is completely negligible. Unfortunately, one can¬ 
not verify this statement directly with the spreadsheets. 
Students in an introductory class have little trouble be¬ 
lieving this result, when reminded of the fact that macro¬ 
scopic systems contain on order of 10^^ particles and en¬ 
ergy units. In an upper-division course, one can prove 
using Stirling’s approximation that the relative width of 
the peak is of order I/'/N or Ij^fq, whichever is larger. 
Thus, statistical fluctuations away from the most likely 
macrostate will be only about one part in 10^^ for macro¬ 
scopic systems. 

Using this result, we can state the second law more 
strongly: Aside from fluctuations that are normally much 
too small to measure, any isolated macroscopic system 
will inevitably evolve toward its most likely accessible 
macrostate. 

Although we have proved this result only for a system 
of two weakly coupled Einstein solids, similar results ap¬ 
ply to all other macroscopic systems. The details of the 
counting become more complex when the energy units 
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FIG. 3. Spreadsheet calculation of the multiplicity of each macrostate, for two larger Einstein solids sharing 100 energy units. 
Here solids A and B contain 300 and 200 energy units, respectively. Only the first few lines of the table are shown; the table 
continues down to qa = 100. The final column is plotted in the graph at right. Notice from the graph that the multiplicity at 
gA = 60 is more than 10^® times larger than at gA = 0. 


can come in different sizes, but the essential properties 
of the combinatorics of large numbers do not depend on 
these details. If the subsystems are not weakly coupled, 
the division of the whole system into subsystems becomes 
a mere mental exercise with no real physical basis; never¬ 
theless, the same counting arguments apply, and the sys¬ 
tem will still exhibit irreversible behavior if it is initially 
in a macrostate that is in some way “inhomogeneous”. 

IV. ENTROPY AND TEMPERATURE 

Instead of always working with multiplicities, it is con¬ 
venient to define the entropy of a system as 

S' = fclnO. (8) 

The factor of Boltzmann’s constant is purely conven¬ 
tional, but the logarithm is important: It means that, 
for any given macrostate, the total entropy of two weakly 
interacting^^ systems is the sum of their individual en¬ 
tropies: 

'^’totai — A:ln(OAlIi?) 

= fc In Oa -b fc In Ob 
= Sa + Sb. (9) 

Since entropy is a strictly increasing function of multi¬ 
plicity, we can restate the second law as follows: Aside 
from fluctuations that are normally much too small to 
measure, any isolated macroscopic system will inevitably 
evolve toward whatever (accessible) macrostate has the 
largest entropy. 

It is a simple matter to insert columns for Sa, Sb, 
and S'totai into the spreadsheet in Fig. 3. A graph of 


these three quantities is shown in Fig. 4. Notice that 
S'totai is not a strongly peaked function. Nevertheless, 
the analysis of the previous section tells us that, when 
this system is in equilibrium, it will almost certainly be 
found in a macrostate near qA = 60. 

Now let us ask how entropy is related to temperature. 
The most fundamental way to define temperature is in 
terms of energy flow and thermal equilibrium: Two ob¬ 
jects in thermal contact are said to be at the same tem¬ 
perature if they are in thermal equilibrium, that is, if 
there is no spontaneous net flow of energy between them. 
If energy does flow spontaneously from one to the other. 



FIG. 4. A spreadsheet-generated plot of Sa, Sb, and S'totai 
for the system of two Einstein solids represented in Fig. 3. At 
equilibrium, the slopes of the individual entropy graphs are 
equal in magnitude. Away from equilibrium, the solid whose 
slope dS/dq is steeper tends to gain energy, while the solid 
whose slope dS/dq is shallower tends to lose energy. 
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then we say the one that loses energy has the higher tem¬ 
perature while the one that gains energy has the lower 
temperature. 

Referring again to Fig. 4, it is not hard to iden¬ 
tify a quantity that is the same for solids A and B 
when they are in equilibrium. Equilibrium occurs when 
5'totai reaches a maximum, that is, when the slope 
dStotai/dqA = 0. But this slope is the sum of the slopes 
of the individual entropy graphs, so their slopes must be 
equal in magnitude: 


a movable partition, invoking the second law to identify 
pressure by the relation P = T{dS/dV)u- Combining 
this relation with Eq. (11) one obtains the thermody¬ 
namic identity dU = TdS + {—PdV). For quasistatic 
processes (in which the change in volume is sufficiently 
gradual), the second term is the (infinitesimal) work W 
done on the system.^® But the first law says that for any 
process, dU = Q + W, where Q is the (infinitesimal) 
energy added by heating. Therefore, for quasistatic pro¬ 
cesses only, we can identify TdS = Q or 


dSA 

dqA 


dSs 

dqA 


at equilbrium. 


( 10 ) 


If we were to plot Sb vs. qs instead of qA, its slope at 
the equilbrium point would be equal, in sign and mag¬ 
nitude, to that of SA{qA)- So the quantity that is the 
same for both solids when they are in equilibrium is the 
slope dS/dq. Temperature must be some function of this 
quantity. 

To identify the precise relation between temperature 
and the slope of the entropy vs. energy graph, look now 
to a point in Fig. 4 where qA is larger than its equilibrium 
value. Here the entropy graph for solid B is steeper than 
that for solid H, meaning that if a bit of energy were to 
pass from AtoB, solid B would gain more entropy than 
solid A loses. Since the total entropy would increase, the 
second law tells us that this process will happen spon¬ 
taneously. In general, the steeper an object’s entropy 
vs. energy graph, the more it “wants” to gain energy (in 
order to obey the second law), while the shallower an ob¬ 
ject’s entropy vs. energy graph, the less it “minds” losing 
a bit of energy. We therefore conclude that temperature 
is inversely related to the slope dS/dU. In fact, the recip¬ 
rocal {dS/dU)~^ has precisely the units of temperature, 
so we might guess simply 


1 

T 


dU' 


( 11 ) 


The factor of Boltzmann’s constant in the definition (8) 
of entropy eliminates the need for any further constants 
in this formula. To confirm that this relation gives tem¬ 
perature in ordinary Kelvin units one must check a par¬ 
ticular example, as we will do in the following section. 

Our logical development of the concepts of entropy 
and temperature from statistical considerations is now 
complete. In the following section, we will apply these 
ideas to the calculation of heat capacities and other ther¬ 
mal properties of some simple systems. However, at this 
point in the development, many instructors will wish to 
first generalize the discussion to include systems (such as 
gases) whose volume can change. The derivatives in Eqs. 
(10) and (11) then become partial derivatives at fixed 
volume, and one cannot simply rearrange Eq. (11) to ob¬ 
tain dS = dU/T. There are at least two ways to get to 
the correct relation between entropy and temperature, 
and we now outline these briefly. 

The standard approach in statistical mechanics texts^® 
is to first consider two interacting systems separated by 


dS = ^ (quasistatic processes only). (12) 

Erom this relation one can go on to treat a variety of 
applications, most notably engines and refrigerators. 

In an introductory course, however, there may not be 
time for the general discussion outlined in the previous 
paragraph. Eortunately, if one does not need the thermo¬ 
dynamic identity, some of the steps can be bypassed (at 
some cost in rigor). We have already seen that, when the 
volume of a system does not change, its entropy changes 
by 




(constant volume). 


(13) 


Now consider a system whose volume does change, but 
that is otherwise isolated from its environment. If the 
change in volume is quasistatic (i.e., gradual), then the 
entropy of the system cannot change. Why? Theoreti¬ 
cally, because while the energies of the system’s quantum 
states (and of the particles in those states) will be shifted, 
the process is not violent enough to knock a particle from 
one quantum state to another; thus the multiplicity of the 
system remains fixed. Alternatively, we know from ex¬ 
periment that by reversing the direction of an adiabatic, 
quasistatic volume change we can return the system to 
a state arbitrarily close to its initial state; if its entropy 
had increased, this would not be possible even in the qua¬ 
sistatic limit. By either argument, the work done on a gas 
as it is compressed should not be included in the change 
in energy dU that contributes to the change in entropy. 
The natural generalization of Eq. (13) to non-constant- 
volume quasistatic processes is therefore to replace dU 
with dU — W = Q, the energy added to the system by 
heating alone. Thus we again arrive at Eq. (12). 


V. FURTHER SPREADSHEET CALCULATIONS 

So far in this paper we have used spreadsheet calcu¬ 
lations only to gain a qualitative understanding of the 
second law and the relation between entropy and tem¬ 
perature. Now that we have developed these concepts, 
however, we can use the same tools to make quantita¬ 
tive predictions about the thermal behavior of various 
systems. 
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FIG. 5. Spreadsheet calculation of the entropy, temperature, and heat capacity of an Einstein solid. (The table continues 
down to g = fOO.) The graph at right shows the heat capacity as a function of temperature. To see the behavior at lower 
temperatures one can simply increase the number of oscillators in cell El. 


A. Heat capacity of an Einstein solid 

Figure 5 shows a spreadsheet calculation of the en¬ 
tropy of a single Einstein solid of TV = 50 oscillators 
with anywhere from 0 to 100 units of energy. Then, 
in the fourth column, we have calculated the tempera¬ 
ture T = AU/AS using a pair of closely spaced entropy 
and energy values. We have actually used a centered- 
difference approximation, so the cell D4, for example, 
contains the formula 2/(C5 — C3). Since we have omitted 
the constants k and e from the formulas, the tempera¬ 
tures are expressed in units of e/k. 

We now know the temperature for every energy, or vice 
versa. In practice, however, one usually compares such 
predictions to experimental measurements of the heat ca¬ 
pacity, defined (for systems at constant volume) as 

C = ^ (constant volume). (14) 

This quantity, normalized to the number of oscillators, is 
computed in the fifth column of the table, again using a 
centered-difference approximation (for instance, cell E5 
contains the formula (2/(D6 — D4))/$E$1). Since we are 
still neglecting dimensionful constants, the entries in the 
column are actually for the quantity C/{Nk). 

To the right of the table is a spreadsheet-generated 
graph of the heat capacity vs. temperature for this sys¬ 
tem. This theoretical prediction can now be compared 
to experimental data, or to the graphs often given in 
textbooks.The quantitative agreement with experi¬ 
ment verifies that the formula 1/T = dS/dU is proba¬ 
bly correct.^® At high temperatures we find the constant 
value C = Nk, as expected from the equipartition the¬ 
orem (with each oscillator contributing two degrees of 
freedom). At temperatures below e/k, however, the heat 
capacity drops off sharply. This is just the qualitative be¬ 
havior that Einstein was trying to explain with his model 
in 1907. 


To investigate the behavior of this system at lower tem¬ 
peratures, one can simply increase the number of oscilla¬ 
tors in cell El. With 45000 oscillators the temperature 
goes down to about Q.le/k, corresponding to a heat ca¬ 
pacity per oscillator of about .005A:. At this point it is 
apparent that the curve becomes extremely flat at very 
low temperatures. Experimental measurements on real 
solids confirm that the heat capacity goes to zero at low 
temperature, but do not confirm the detailed shape of 
this curve. A more accurate treatment of the heat ca¬ 
pacities of solids requires more sophisticated tools, but is 
given in standard textbooks.^® 

A collection of identical harmonic oscillators is actually 
a more accurate model of a completely different system: 
the vibrational degrees of freedom of an ideal diatomic 
gas. Here again, experiments confirm that the equipar¬ 
tition theorem is satisfied at high temperatures but the 
vibration (and its associated heat capacity) “freezes out” 
when kT <C e. Graphs showing this behavior are included 
in many textbooks. 


B. The Boltzmann distribution 

Perhaps the most useful tool of statistical mechanics 
is the Boltzmann factor, which gives the rela¬ 

tive probability of a system being in a microstate with 
energy E, when it is in thermal contact with a much 
larger system (or “reservoir”) at temperature T. A fairly 
straightforward derivation of this result can be found in 
most textbooks on statistical mechanics.A less general 
derivation, based on the exponentially decreasing density 
of an isothermal atmosphere, is given in Serway’s intro¬ 
ductory text.^^ 

Although it is no substitute for an analytic treatment, 
a spreadsheet calculation can easily display this exponen¬ 
tial dependence for the case of a single one-dimensional 
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FIG. 6. States of a single oscillator in thermal contact with a large reservoir of identical oscillators. A graph of the logarithm 
of the multiplicity vs. the oscillator’s energy has a constant, negative slope, in accord with the Boltzmann distribution. 


oscillator in thermal contact with a large Einstein solid. 
Figure 6 shows such a calculation, for the parameters 
Na = 1, Nb = 1000, and (/total = 100. Here solid A 
is the “system”, while solid B, which is much larger, 
is the “reservoir”. The graph shows the natural loga¬ 
rithm of the total multiplicity, plotted as a function of 
QA- According to the fundamental assumption, the total 
multiplicity is proportional to the probability of finding 
the small system in each given microstate. Note that the 
graph is a straight line with a negative slope: This means 
that the probability does indeed decay exponentially (at 
least approximately) as the energy E = eqA of the small 
system increases. 

According to the Boltzmann factor, the slope of the 
graph of multiplicity (or probability) vs. qa = E/e should 
equal —e/kT. Since the small system always has unit 
multiplicity and zero entropy, the entropy of the com¬ 
bined system is the same as the entropy of the reservoir: 
•Stotai = Sb- Once they know this, students can check 
either numerically or analytically that the slope of the 
graph is 


5 _ e OSb _ e OSb _ e 

dqA ~ kdUA ~ k dUB ~ kTB 


(15) 


where the derivatives and the temperature Tg are all 
evaluated at Ua = 0. 


C. Thermal behavior of a two-state paramagnet 


qualities. To carry out our spreadsheet calculations, how¬ 
ever, all we require is mathematical simplicity. 

The simplest possible system would consist of “atoms” 
that have only two allowed energy levels. A common 
example is a paramagnetic material, with one unpaired 
electron per atom, immersed in a uniform magnetic field 
B. Let us say that B points in the +z direction, and 
quantize the spin (hence the magnetic moment) of the 
atom along this axis. When the magnetic moment points 
up, the atom is in the ground state, while when the mag¬ 
netic moment points down, the atom is in the excited 
state. The energy levels of these two states are 


up : E^ = —^iB, 
down : E\^ = +^B, 


(16) 


where fi is the magnitude of the atom’s magnetic mo¬ 
ment. In a collection of N such atoms, the total energy 
will be 


U = N^E^ + N^E^ = ^iB{N^-N^), (17) 

where and iV^ are the numbers of atoms in the up 
and down states. These numbers must add up to N\ 

+ N. (18) 

The total magnetization of the sample is given by 

M = - N^) = -E/B. (19) 


We have used the Einstein solid model in our exam¬ 
ples for several reasons: it is fairly realistic, its behavior 
is intuitive, and, most importantly, it is mathematically 
simple. Other systems generally lack at least one of these 


To describe a macrostate of this system we would have 
to specify the values of N and U, or equivalently, N 
and (or N and N^). The multiplicity of any such 
macrostate is the number of ways of choosing N-^ atoms 
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FIG. 7. Spreadsheet calculation of the entropy, temperature, heat capacity, and magnetization of a two-state paramagnet. 
(The symbol u represents /i, the magnetic moment.) At right is a graph of entropy vs. energy, showing that as energy is added, 
the temperature (given by the reciprocal of the slope) goes to infinity and then becomes negative. 


from a collection of N: 

/'N\ N\ Nl 

From this simple formula we can calculate the entropy, 
temperature, and heat capacity. 

Figure 7 shows a spreadsheet calculation of these quan¬ 
tities for a two-state paramagnet of 100 “atoms”. The 
rows of the table are given in order of increasing energy, 
which means decreasing and decreasing magnetiza¬ 
tion. Alongside the table is a graph of entropy vs. energy. 
Since the multiplicity of this system is largest when 
and are equal, the entropy also reaches a maximum 
at this point {U = 0) and then falls off as more energy 
is added. This behavior is unusual and counter-intuitive, 
but is a straightforward consequence of the fact that each 
“atom” can store only a limited amount of energy. 

To appreciate the consequences of this behavior, imag¬ 
ine that the system starts out with U < 0 and that we 
gradually add more energy. At first it behaves like an 
Einstein solid: The slope of its entropy vs. energy graph 
decreases, so its tendency to suck in energy (in order to 
maximize its entropy in accord with the second law) de¬ 
creases. In other words, the system becomes hotter. As 
U approaches zero, the system’s desire to acquire more 
energy disappears. Its temperature is now infinite, mean¬ 
ing that it will willingly give up a bit of energy to any 
other system whose temperature is finite (since it loses no 
entropy in the process). When U increases further and 
becomes positive, our system actually wants to give up 
energy. Intuitively, we would say that its temperature is 
higher than infinity. But this is mathematical nonsense, 
so it is better to think about the reciprocal of the temper¬ 
ature, 1/T, which is now lower than zero, in other words, 
negative. In these terms, our intuition even agrees with 
the precise relation (11). 


The paramagnetic system can be an invaluable peda¬ 
gogical tool, since it forces students to abandon the naive 
notion that temperature is merely a measure of the aver¬ 
age energy in a system, and to embrace instead the more 
general relation (11), with all its connotations. One can 
even imagine using the paramagnet in place of the Ein¬ 
stein solid as the main paradigm for the lessons of Sec¬ 
tions III and IV. In particular, it is not hard to set up 
a spreadsheet model of two interacting paramagnets, to 
look at how energy can be shared between them. How¬ 
ever, this system exhibits behavior not commonly seen in 
other systems or in students’ prior experience. We there¬ 
fore prefer not to use it as a first example, but rather to 
save it for an upper-level course in which students have 
plenty of time to retrain their intuition. 

Putting these fundamental issues aside, we can go on to 
calculate both the heat capacity and the magnetization 
of our two-state paramagnet as a function of tempera¬ 
ture. Plots of these quantities are shown in Fig. 8. Since 
the heat capacity goes to zero at high temperature, the 
equipartition theorem fails utterly to describe this system 
(as it must, since it applies only to degrees of freedom for 
which the energy is a quadratic function of a coordinate 
or momentum). The magnetization is complete at T just 
greater than zero, but drops off as the temperature is 
increased. The behavior in the high-temperature limit is 
known as Curie’s law, as described in many textbooks.^® 

VI. IMPLEMENTATION DETAILS 

The ideas presented in this paper have been tested, 
in various forms, in calculus-based introductory courses 
at Pomona College, Grinnell College, Smith College, 
Amherst College, and St. Lawrence University, and in an 
upper-division thermodynamics course at Weber State 
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FIG. 8. Graphs of the heat capacity and magnetization as a function of temperature for a two-state paramagnet, generated 
from the last three columns of the spreadsheet shown in Fig. 7. 


University. We have found that students at either level 
are quite able to understand the fundamental concepts 
of statistical mechanics that we are trying to teach. In 
particular, the fact that the statistical approach to the 
second law is more “modern” does not, in our opinion, 
make it unsuitable for first-year students. On the con¬ 
trary, we have had far more success in teaching the sta¬ 
tistical approach than in teaching the concept of entropy 
from the older classical viewpoint used in most texts. 

The use of computers in our approach does not seem 
to pose a barrier to today’s students. Many of them have 
had previous experience with spreadsheet programs, and 
the rest are able to learn very quickly with the help of a 
one-page instruction sheet that we have prepared.^® 


A. Sample exercises 

We generally present all of the material of Section III in 
class, and hand out reproductions of the figures from that 
section. For homework, we ask students to reproduce 
Fig. 1, then change the parameters to look at some larger 
systems. Here is a typical homework assignment, written 
for students who will be using Excel: 

1. List all the possible microstates for an Einstein 
solid containing three oscillators and five units of 
energy. Verify that fl = 

2. Set up an Excel spreadsheet identical (initially) 
to the one shown on the handouts: two Einstein 
solids, each containing three harmonic oscillators, 
with a total of six units of energy. You’ll need to 
type in all the labels and formulas down to row 4, 
as well as cell A5. After that, you can use the 
“Fill Down” command to fill in the rest (except for 
cell Ell). Use the “chart wizard tool” (the second 
icon from the right) to create the graph. Check 
that your spreadsheet yields all the same results 
as on the handout. Then modify your spreadsheet 


to show the case where one Einstein solid contains 
six harmonic oscillators and the other contains four 
harmonic oscillators (with the total number of en¬ 
ergy units still equal to six). Turn in a printout 
of the modified spreadsheet. Assuming that all mi¬ 
crostates are equally likely, what is the most proba¬ 
ble macrostate, and what is its probability? What 
is the least probable macrostate, and what is its 
probability? 

3. Modify your spreadsheet from the previous problem 
to show the case where solid A contains 100 oscilla¬ 
tors, solid B contains 200 oscillators, and there are 
100 units of energy in total. It’s easiest to delete 
the old graph and make a new one, and this time 
it’s best to make it an “XY (scatter)” graph in¬ 
stead of a column graph. Turn in a printout of the 
first several rows of the spreadsheet as well as the 
graph. What is the most probable macrostate, and 
what is its probability? What is the least probable 
macrostate, and what is its probability? Calculate 
the entropies of these two macrostates (expressed 
as unitless numbers, neglecting the factor of Boltz¬ 
mann’s constant). 

4. Starting with your spreadsheet from the previous 
problem, add columns for the entropy of solid A, 
the entropy of solid B, and the total entropy. Print 
a graph showing all three entropies, plotted vs. the 
energy of solid A. Use the formula T = AU/AS to 
calculate the temperatures of both solids (in units 
oie/k) at the equilbrium point and also at the point 
qA = 60. Do your results make sense? Explain. 

We have also given computer-based homework assign¬ 
ments on the material of Section V. In upper-division 
courses we have asked students to generate Fig. 5 before 
seeing it in class. The treatment of this material can vary 
greatly depending on how the class is taught, however, 
so we will not reproduce our homework exercises here. 
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B. Alternative computational environments 

Spreadsheet programs provide an almost ideal com¬ 
putational environment for the calculations described in 
this paper: they are versatile, easy to learn, and readily 
available on most campuses. Other computing options 
may be more suitable in some contexts, however. 

Before we discovered spreadsheets, one of us (T.A.M.) 
wrote a stand-alone program for the Macintosh to pro¬ 
duce tables and graphs such as those shown in Figs. 1 
and 3. The stand-alone program is even easier to use 
than a spreadsheet, and can conveniently handle some¬ 
what larger systems and values of g. It also allows one to 
completely omit formula (3) from the course if desired— 
students can simply be asked to verify the computer’s 
computations in a few simple cases. This program is 
sufficient to teach the core of our approach, as outlined 
in Section III. A copy of the program is available on 
request.^^ 

A much cheaper, but less convenient, option is to per¬ 
form the calculations on a modern graphing calculator. 
We do not particularly recommend this; in our experi¬ 
ence, graphing calculators are much harder to use than 
spreadsheet programs. However, a motivated student 
who already knows how to use the calculator should be 
able to reproduce all the major results in this paper with¬ 
out too much difficulty. As an example, we describe here 
an appropriate set of instructions for the TI-82.^® 

To set up tables like those shown in Section III, one can 
use the “table” feature of the TI-82, which displays seven 
rows at a time, calculating each row as it is displayed. 
The first column of the table, labeled X, should be used 
for QA- The following formulas in the “Y=” screen will 


then generate the remaining four columns: 

Yi = (X -t A - 1) nCr X 
Y 2 = Q - X 

Y 3 = (Ya -b B - 1) nCr Y 2 
Y4 = Yi * Y3 

Here we are using variables A, B, and Q to hold the con¬ 
stants Na, Nb, and gtotah respectively. Before plotting a 
graph, it is best to set Xmin to zero and Xmax to 94; this 
insures that each pixel corresponds to an integer value of 

X. 

To calculate temperatures and heat capacities on the 
TI-82, one must use “lists” instead of “tables”. The fol¬ 
lowing sequence of instructions will reproduce most of 
Fig. 5, storing g, O, S/k, kT/e, and C/Nk in lists Li 
through L 5 : 

seq(X,X, 0,50,1) ^ Li 

seq((X -b A - 1) nCrX, X, 0, 50, 1) ^ La 

ln(L2) —> L3 

seq( 2 /(L 3 (X -b 2) - L 3 (X)), X, 1, 49, 1) ^ L 4 
seq( 2 /(L 4 (X -b 2) - L 4 (X))/A, X, 1, 47, 1) ^ Lg 

Again we assume that the number of oscillators is stored 
in variable A. Lists 4 and 5 will be offset upward by one 
and two places respectively, but this can be fixed by en¬ 
tering “stat-edit” mode and inserting zeros. One should 
also add zeros at the end to make all lists the same length. 
It is then a simple matter to plot the heat capacity vs. 
the temperature, as shown in Fig. 5. Unfortunately, the 
lists will not update automatically when the value of A is 
changed. 


* tmoore@pomona.edu 
^ dschroeder@weber.edu 

^ An overview of various ways of thinking about entropy has 
been given by Keith Andrew, “Entropy,” Am. J. Phys. 
52(6), 492-496 (1984). 
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Walker, Fundamentals of Physics (Wiley, New York, 1993), 
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of) the increase of entropy, even though life apparently in¬ 
volves an increase of order in the universe. Similarly, it is 
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tropy than a simple and seemingly orderly cup of the same 


amount of water. 
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New York, 1984), pp. 191-192. A very nice indirect ap- 
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proach to the multiplicity of an ideal gas has been given by 
David K. Nartonis, “Using the ideal gas to illustrate the 
connection between the Clausius and Boltzmann defini¬ 
tions of entropy,” Am. J. Phys. 44(10), 1008-1009 (1976). 

® See, for example, Henry A. Bent, The Second Law (Oxford 
University Press, New York, 1965), pp. 144-162; Herbert 
B. Callen, Thermodynamics and an Introduction to Ther¬ 
mostatistics (Wiley, New York, 1985), 2nd ed., p. 334; W. 
G. V. Rosser, An Introduction to Statistical Physics (Ellis 
Horwood Limited, Chichester, 1982), pp. 31-41; Charles 
A. Whitney, Random Processes in Physical Systems (Wi¬ 
ley, New York, 1990), pp. 97-139. An even simpler model 
is a two-state system, as treated, for example, in Charles 
Kittel and Herbert Kroemer, Thermal Physics (Freeman, 
San Francisco, 1980), 2nd ed., pp. 10-21. We treat this 
model in Section V.C below, and also discuss there why 
we don’t use it as our primary example. 

Callen, Ref. 9, p. 334. 

This same example has been used independently by Whit¬ 
ney, Ref. 9, p. 126. We are grateful to one of our reviewers 
for pointing out this reference to us. 

A nice calculation of the width of the peak for a simpler 
system has been given by Ralph Baierlein, “Teaching the 
approach to thermodynamic equilibrium: Some pictures 
that help,” Am. J. Phys. 46(10), 1042-1045 (1978). 

The definition of entropy, like that of macrostate or mul¬ 
tiplicity, depends on the time scale under consideration. 
Here we are interested in time scales that are long com¬ 
pared to the relaxation time of each individual system, but 
short compared to the relaxation time of the composite sys¬ 
tem. For a strongly coupled system this clean separation 
of time scales would not be possible. Note that on very 
long time scales, even our weakly coupled system would 
have a slightly larger entropy, equal to fc In fl where is 
the total multiplicity for all allowed values of Ua and Ub- 
For macroscopic systems this number is practically indis¬ 
tinguishable from the quantity kln{flALlB) computed for 
the most likely macrostate. A careful discussion of the role 
of time scales in defining entropy is given in L. D. Lan¬ 
dau and E. M. Lifshitz, Statistical Physics, tr. J. B. Sykes 
and M. J. Kearsley (Pergamon, Oxford, 1980), 3rd edition. 
Part 1, p. 27. 

Notice that the preceding argument depends crucially on 
the additivity of S' = fc In for the composite system. Thus 
the logarithm in the definition of S is essential, if S and T 
are to be related in a simple way. 

For instance, F. Mandl, Statistical Physics (Wiley, Chich¬ 


ester, 1988), 2nd ed., pp. 47, 83-87. 

The standard notation is dW, but it is too tempting to 
read this incorrectly as the “change in work” (a mean¬ 
ingless phrase), rather than correctly as an infinitesimal 
“amount of work”. We therefore call it simply W, with 
the understanding that in this context it is an infinitesi¬ 
mal quantity. Similarly, we use Q instead of dQ. Note also 
that we take W to be positive when work is done on the 
system. 

See, for instance, Halliday, Resnick, and Walker, Ref. 2, 
Fig. 20-2. 

Most textbooks define the temperature scale operationally 
in terms of a gas thermometer. The most direct verifica¬ 
tion of 1/T — dS/dU would therefore be to apply this 
formula directly to an ideal gas. But the gas thermometer 
can be used to measure the heat capacity of a solid, and 
this result, in turn, can be compared to our theoretical 
prediction. Note, in particular, that the factor of Boltz¬ 
mann’s constant in the definition of S conveniently makes 
the temperature come out in ordinary Kelvin units, with 
no further constants needed. 

For instance, Mandl, Ref. 15, chapter 6. 

For instance, Halliday, Resnick, and Walker, Ref. 2, Fig. 
21-13. 

For instance, Callen, Ref. 9, p. 350; Mandl, Ref. 15, pp. 
52-56; Stowe, Ref. 8, pp. 284-287. 

Serway, Ref. 2, pp. 599-601. 

Similar calculations can be done by hand, albeit for a some¬ 
what smaller “large” system. See Whitney, Ref. 9, p. 128. 
The two-state model system is used to introduce statistical 
concepts in the popular text of Kittel and Kroemer, op. 
cit.. This text includes a nice calculation of the sharpness 
of the multiplicity function for a system of two interacting 
paramagnets. 

Halliday, Resnick, and Walker, Ref. 2, p. 928. 

This instruction sheet, which is written for users of Ex¬ 
cel on the Macintosh, is available on request from Daniel 
Schroeder. [Update: The instructions are now available at 
<http: //physics . weber. edu/thermal/computer .html>.] 
Please send requests to Thomas Moore. [Update: Versions 
of this computer program for Mac OSX, Windows, and 
Linux are now available at <http: //www. physics. pomona. 
edu/sixideas/sicpr .html>, and a Web-based version is 
at <http: //physapps .pomona. edu/>.[ 

Since the TI-82 overflows at 10^®’’, one is limited to some¬ 
what smaller systems than we have used in our earlier ex¬ 
amples. In practice this is not much of a limitation. 



